A note on faithful coupling of Markov chains

نویسندگان

  • Debojyoti Dey
  • Pranjal Dutta
  • Somenath Biswas
چکیده

One often needs to turn a coupling (Xi, Yi)i≥0 of a Markov chain into a sticky coupling where once XT = YT at some T , then from then on, at each subsequent time step T ′ ≥ T , we shall have XT ′ = YT ′ . However, not all of what are considered couplings in literature, even Markovian couplings, can be turned into sticky couplings, as proved by Rosenthal [Ro97] through a counter example. Rosenthal then proposed a strengthening of the Markovian coupling notion, termed as faithful coupling, from which a sticky coupling can indeed be obtained. We identify the reason why a sticky coupling could not be obtained in the counter example of Rosenthal, which motivates us to define a type of coupling which can obviously be turned into a sticky coupling. We show then that the new type of coupling that we define, and the faithful coupling as defined by Rosenthal [Ro97], are actually identical. Our note may be seen as a demonstration of the naturalness of the notion of faithful coupling.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Faithful couplings of Markov chains: now equals forever

This short note considers the usual coupling approach to bounding convergence of Markov chains. It addresses the question of whether it suffices to have two chains become equal at a single time, or whether it is necessary to have them then remain equal for all future times. Let P (x, ·) be the transition probabilities for a Markov chain on a Polish state space X . Let μ and ν be two initial dis...

متن کامل

Markov chains and mixing times ( part 2 - coupling )

This week’s post continues last week’s discussion of Markov chains and mixing times, and introduces the idea of coupling as a method for estimating mixing times. We remark that some nice notes on the subject of coupling (and others) can be found on Steve Lalley’s web page – of particular relevance for our purposes here are the notes on “Convergence rates of Markov chains”. A more thorough and c...

متن کامل

Empirical Bayes Estimation in Nonstationary Markov chains

Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical  Bayes estimators  for the transition probability  matrix of a finite nonstationary  Markov chain. The data are assumed to be of  a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...

متن کامل

Evaluation of First and Second Markov Chains Sensitivity and Specificity as Statistical Approach for Prediction of Sequences of Genes in Virus Double Strand DNA Genomes

Growing amount of information on biological sequences has made application of statistical approaches necessary for modeling and estimation of their functions. In this paper, sensitivity and specificity of the first and second Markov chains for prediction of genes was evaluated using the complete double stranded  DNA virus. There were two approaches for prediction of each Markov Model parameter,...

متن کامل

The Rate of Rényi Entropy for Irreducible Markov Chains

In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • CoRR

دوره abs/1710.10026  شماره 

صفحات  -

تاریخ انتشار 2017